# Continuous pre - training

Poro 2 8B Instruct is an instruction - following chatbot model based on the Llama 3.1 8B architecture, designed for conversational AI applications in Finnish and English.

JPharmatron-7B-base is a large language model with 7 billion parameters in Japanese and English, specifically designed for pharmaceutical applications and research.

Llama 3.3 Swallow is a large language model with 70 billion parameters, built on Meta Llama 3.3, which enhances Japanese capabilities while retaining English capabilities.

Llama 3.1 Swallow is a series of large language models that are continuously pre - trained based on the Meta Llama 3.1 model, enhancing Japanese capabilities while retaining English capabilities.

Llama-VARCO-8B-Instruct is a generative model built on Llama. Through additional training, it performs excellently in Korean processing while maintaining English proficiency.

Llama3-Preferred-MedSwallow-70B is a fine - tuned model that undergoes continuous pre - training based on the original corpus of medical - related texts and is specifically designed for the medical research field.

A large Japanese - enhanced language model built on Meta Llama 3, which improves Japanese processing capabilities through continuous pre - training and instruction fine - tuning.